Papers with clustering quality
A Rank-Based Similarity Metric for Word Embeddings (P18-2)
Copied to clipboard
| Challenge: | Word Embeddings have become a standard for word representations, with vector cosine being the only similarity metric. |
| Approach: | They propose to use rank-based similarity estimation metrics to measure word similarity . they find WE outperforms vector cosine in the recent outlier detection task . |
| Outcome: | The proposed rank-based measure outperforms vector cosine in the recent outlier detection task. |
Alignment Quality Index (AQI) : Beyond Refusals: AQI as an Intrinsic Alignment Diagnostic via Latent Geometry, Cluster Divergence, and Layer wise Pooled Representations (2025.emnlp-main)
Copied to clipboard
Abhilekh Borah, Chhavi Sharma, Danush Khanna, Utkarsh Bhatt, Gurpreet Singh, Hasnat Md Abdullah, Raghav Kaushik Ravi, Vinija Jain, Jyoti Patel, Shubham Singh, Vasu Sharma, Arpita Vats, Rahul Raja, Aman Chadha, Amitava Das
| Challenge: | a new metric measures the quality of large language models (LLMs) that detects hidden misalignments and jailbreak risks. |
| Approach: | They propose a decoding-invariant metric that measures latent safety failures . they propose 'Alignment Quality Index' to measure latent activations in latent space . |
| Outcome: | The proposed metric detects latent safety failures overlooked by behavioral benchmarks and jailbreaks. |
TingIS: Real-time Risk Event Discovery from Noisy Customer Incidents at Enterprise Scale (2026.acl-industry)
Copied to clipboard
| Challenge: | a 5minute downtime for an incident could result in a loss of 40 million dollars and erosion of user trust. |
| Approach: | They propose a multi-stage event unification engine that synergizes efficient indexing techniques with Large Language Models (LLMs) to make informed decisions on event merging. |
| Outcome: | The proposed system outperforms baseline methods in routing accuracy, clustering quality, and Signal-to-Noise Ratio. |
Dial-In LLM: Human-Aligned LLM-in-the-loop Intent Clustering for Customer Service Dialogues (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing intent clustering methods rely on embedding distance metrics and neglect of underlying semantic structures. |
| Approach: | They propose an LLM-in-the-loop framework that integrates language understanding capabilities into conventional clustering algorithms. |
| Outcome: | The proposed framework outperforms baselines in Chinese and improves quality, cost efficiency and downstream applications. |
ClusterLLM: Large Language Models as a Guide for Text Clustering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments on 14 datasets show that ClusterLLM consistently improves clustering quality, at an average cost of $0.6 per dataset. |
| Approach: | They propose a text clustering framework that leverages feedback from an instruction-tuned large language model, such as ChatGPT. |
| Outcome: | Extensive experiments on 14 datasets show that ClusterLLM consistently improves clustering quality, at an average cost of $0.6 per dataset. |